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1 This application is submitted in the name of the following inventor(s): 

2 

3 Inventor Citizenship Residence City and State 

4 David L. Isaman United States San Diego, California 
5 

6 The assignee is MetaFlow Technology, Inc., having an office at 4250 Ex- 

7 ecutive Square, Suite 300, La Jolla, CA 92037. 
8 

f 9 Title of Invention 

xs ::= 

f=4 1 Symbolic Store-Load Bypass 

ii 2 

1=413 Related Applications 

\ J 

"-"15 This application claims priority to copending provisional application num- 

16 ber (M/l 14,295 entitled "Symbolic Store-Load Bypass", filed December 31, 1998, by the 



17 same inventor. «n5 
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19 The inventions described herein can be used in combination or conjunction 

20 with inventions described in the following patent applications (2): 

21 
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1 • Application Serial No. 60/1 14296, Express Mail Mailing No. EE506030698US, filed 

2 December 31, 1998, in the name of Anatoly Gelman, titled "Call Return Branch Pro- 

3 duction Buffer," assigned to the same assignee, attorney docket number META-013, 

4 and all pending cases claiming priority thereof; and 4^j^ 



6 • Application Serial No. G6mgm, Express Mail Mailing No. EE506030684US, filed 



44* $ 




December 31, 1998, in the name of Anatoly Gelman and Russell Schapp, titled 
8 "Block-Based Branch Table Buffer," assigned to the same assignee, attorney docket 
u 9 number META-0 1 4, and all pending cases claiming priority thereof. 

l J i These applications are hereby incorporated by reference as if fully set forth 

£312 herein. These applications are collective referred to herein as "incorporated disclosures". 

f fl 3 

I - 
a. .J: 

tji5 Background of the Invention 

16 

17 1. Field of the Invention 
18 

1 9 This invention relates to microprocessor design. 

20 
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1 2. Related Art 
2 

3 microprocessors employing pipelined architecture, it is desirable to be in 

4 the process of executing as many instructions as possible, so that each element of the 

5 pipeline is maintained busy. Ffqwever, some instructions, such as instructions that load 

6 data from external memory or stage dafesinto external memory, must generally be exe- 

7 cuted in their original sequence order, so as to^avoid the external memory ever being in 

8 an incorrect state. Moreover, when such instructions rd^e*4oidentical external memory 

9 locations, where is no particular need to wait for the actual external memory operations to 
-;io complete, as the identical data is already available for the processor to operate^ 
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One problem in the known art is that determining whether two different in- 
structions refer to the identical location in external memory generally requires computing 
the actual external memory address referenced by each of the two different instructions. 
This prolongs when the determination can be made, because it requires time (and typi- 
cally, a pipeline stage) to actually compute the referenced external memory addresses. 

Accordingly, it would be advantageous to provide a technique for operating 
a pipelined microprocessor morg^tiuic^ly, by detecting instructions that load from identi- 
cal memory locations as were recently stored to, wftfoouthaving to actually compute the 
referenced external memory addresses. In a preferred embodimenVthe^nicroprocessor 
examines the symbolic structure of instructions as they are encountered, so as to beai^ 
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detect identical memory locations by examination of their symbolic structure. For ex- 

2 ample, instnictioTis~tha^store to and load from an identical offset from an identical regis- 

3 ter are determined to be referencmgShe identical memory locations, without having to 

4 actually compute the complete physical target adate§§. 
5 

6 Summary of the Invention 

7 

8 The invention provides a method and system for operating a pipelined mi- 

9 croprocessor more quickly, by detecting instructions that load from identical memory lo- 
io cations as were recently stored to, without having to actually compute the referenced ex- 

!» 

:|i temal memory addresses. The microprocessor examines the symbolic structure of in- 
structions as they are encountered, so as to be able to detect identical memory locations 

1 3 by examination of their symbolic structure. For example, in a preferred embodiment, in- 

14 structions that store to and load from an identical offset from an identical register are de- 
ls termined to be referencing the identical memory location, without having to actually 
j 

1 6 compute the complete physical target address. 

17 

18 /// 
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l Brief Description of the Drawings 

2 

3 Figure 1 shows a block diagram of a system in a pipelined microprocessor 

4 for detecting identical locations referenced by different load and store instructions. 
5 

6 Figure 2 shows a process flow diagram of a method for operating a system 

7 in a pipelined microprocessor for detecting identical locations referenced by different 

8 load and store instructions. 



30 Detailed Description of the Preferred Embodiment 



L J 1 

: s 
pa 

Cy 2 In the following description, a preferred embodiment of the invention is de- 

Q 

[ j 3 scribed with regard to preferred process steps and data structures. Embodiments of the 
M 4 invention can be implemented using circuits in a microprocessor or other device, adapted 
' | 5 to particular process steps and data structures described herein. Implementation of the 

16 process steps and data structures described herein would not require undue experimenta- 

1 7 tion or further invention. 
18 

19 /// 

20 /// 

21 /// 

22 /// 
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1 System Elements 



3 Figure 1 shows a block diagram in a pipelined microprocessor for detecting 

4 identical locations referenced by different load and store instructions. 

5 

6 A microprocessor 100 includes a sequence of pipeline stages, including an 

7 instruction fetch state 1 10 5 an instruction decode state 120, an address computation state 

8 130 and an instruction execution state 140. In a preferred embodiment, the pipeline 

9 stages of the microprocessor 100 operate concurrently on sequences of instructions 151 in 

r : 

% jo a pipelined manner. Pipeline operation is known in the art of microprocessor design. 

fljl 

~ =7 
;= :£ 

\M In operation, the microprocessor 100 is coupled to an instruction memory 

r ~ 

f 13 150 which includes a plurality of instructions 1 5 1 , at least some of which are memory 

\\A load or store instructions. In a preferred embodiment, the instruction memory 150 in- 

sM eludes a random access memory. Memory caching operations can be performed either by 

16 the instruction memory 1 50, input and output elements of the microprocessor 100, or 

1 7 both. Memory caching operations, as well as other aspects of reading and writing mem- 

18 ory locations, are known in the art of computer memories and so are not further described 

19 herein. 

21 ^^S* The microprocessorNlOO reads a sequence of instructions 151 from the in- 

22 struction memory 150 using the instruction fetch stage 110 (and including any associated 



6 




130.1012.02 



read or write elements in the microprocessor 100). In a preferred embodiment, 

2 the input instruction buffer 1 KHnclmies-a^urality of instructions 151 from the instruc- 

3 tion memory 150, but there is no particular requirement therefo 



The instruction fetch stage 110 couples the instructions to the instruction 



6 decode state 120. 
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The instruction decode stage 120 parses the instructions 151 to determine 
what types of instructions 151 they are (such as instructions 151 that load data from ex- 
ternal memory or store data to external memory). As part of the parsing instructions 151, 
and in addition to determine what operations the instructions 151 command the micro- 
processor 100 to perform, the instruction decode stage 120 determines the syntax of any 
addresses in the external memory that the instructions 151 refer to as operands. 

For example, an instruction that loads data from external memory has a 
format that refers to the specific location in external memory from which to load the data. 
The format can include a base address value and an offset address value, which are to be 
added to compute the effective reference address of the instruction 151. The base address 
value can be a constant value or specify a value found in an internal register of the micro- 
processor 100. Similarly, the offset address value can be a constant value or specify a 
value found in an internal register of the microprocessor. 
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Hmilarly, an instruction that stores data to external memory has a format 

2 that refers to the specific locationuTExteQia^ memory from which to store the data. The 

3 format can similarly include a base address value and an>££set address value, which are 

4 used to compute the effective reference address of the instruction 
5 

6 The instruction decode stage 120 couples the parts of the instruction 151, 

7 including information about the base address value and the offset address value, to the 

8 address computation stage 130. 
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The address computation stage 130 receives the base address value and the 
offset address value, and computes the effective reference address of the instruction 151. 

The instruction decode stage 120 couples the parts of the instruction 151, 
including information about what operations the instructions 151 command the micro- 
processor 100 to perform, and what the syntax of any addresses the instructions 151 refer 
to as operands, to the instruction execution stage 140. The address computation stage 130 
couples the effective reference address of the instruction 151, to the instruction execution 
stage 140. 



The instruction decode stage 120 includes a symbolic load-store bypass 

21 element 121. The bypass element 121 examines the parts of the instruction 151, includ- 

22 ing information about what operations the instructions 151 command the microprocessor 
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1 100 to perform. If these operations are to load data from external memory, or to store 

2 data to external memory, the bypass element 121 further examines the syntax of any ad- 

3 dresses 1 5 1 refer to as operands. 
4 

5 . If the operand addresses the instructions 151 refer to include identical base 

6 address values and offset address values, the bypass element 121 generates a bypass sig- 

7 nal indicating that the instructions 1 5 1 refer to the same location in external memory. 
8 

„ 9 When the bypass signal is generating, the address computation stage 130, 

3o does not have to compute the actual effective address for the microprocessor 100 to act on 

m l the knowledge that the instructions 1 5 1 refer to identical locations in external memory. 

S3 12 



s i 3 For example, suppose that a first instruction 15 1 to store data refers to a lo- 

M 4 cation in external memory determined as (contents of register A) + (fixed offset value B), 

Ji5 and a second instruction 151 to load data refers to the same location in external memory 

16 determined as (contents of register A) + (fixed offset value B), where A and B are identi- 

17 cal. In this case, the microprocessor 100 can proceed with the knowledge that the first 

18 (store) instruction 151 and the second (load instruction) 151 refer to the same location. 

19 Since the second (load) instruction 151 is going to read the same data from external 

20 memory that the first (store) instruction 151 put there, the microprocessor 100 can pro- 

21 ceed by using that data from an internal register, rather than waiting for external memory 

22 to complete actual store and load operations. 
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lthough the actual first (store) instruction 151 would be physically per- 

2 formed and completed by external memory, the microprocessor 100 can proceed without 

3 physically performing the second (load) instruction 15 1. Instead, the microprocessor 100 

4 can use the identical rata from it's internal register, thus removing a relative delay in mi- 

5 croprocessor 100 operatic 
6 

7 Method of Operation 
8 

f ^9 Figure 2 shows a process flow diagram of a method for operating a system 

-10 in a pipelined microprocessor for detecting identical locations referenced by different 

H l load and store instructions. 

- :n: 

y= 

B 

M3 A method 200 is performed by the microprocessor 100, including its se- 

44 quence of pipeline stages. In a preferred embodiment, as many steps of the method 200 

lis are performed concurrently in a pipelined manner. Pipeline operation is known in the art 

1 6 of microprocessor design. 

17 

18 At a flow point 210, microprocessor 100 is coupled to an instruction mem- 

19 ory 150, which includes a plurality of instructions 151, and is ready to perform those in- 

20 structions 151. At least some of those instructions 151 are memory load or store instruc- 

21 tions. 

22 
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1 At a flow point 211, the microprocessor reads a sequence of instructions 

2 151 from the memory 1 50 using the instruction fetch stage 1 10 (and including any associ- 

3 ated memory read or write elements in the microprocessor 100). 
4 

5 At a step 212, the instruction fetch stage 1 10 couples the instructions 151 to 

6 the instruction decode stage 120. 

7 

8 At a step 213(a), the instruction decode stage 120 parses the instructions 



p 9 151 to determine whether they are instructions 151 that load data from external memory 

o or store data to external memory. 

Si :r: 
: 

r n 

□12 At a step 213(b), the instruction decode stage 120 determines the syntax of 

: U i 3 any addresses in the external memory that the instructions 1 5 1 refer to as operands. 

k J 

y 15 At a step 214, the bypass element 121 examines the parts of the instruction 

16 151, including information about what operations the instructions 151 command the mi- 

17 croprocessor 100 to perform. If these operations are to load data from external memory, 

18 or to store data to external memory, the method continues with the step 215. If these op- 

1 9 erations are otherwise, the method continues with the step 22 1 . 

20 

21 In a step 215, a record of the symbolic operands of the store operations to 

22 external memory is stored in a table that is indexed by the instruction ID. 

11 
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1 In a step 216, each load instruction's operands are compared against both 

2 the store instructions being issued in the ongoing clock cycle and those of all unretired 

3 store instructions. By storing the record of these operations for comparison, there is a 

4 much higher probability of detecting a useful bypass in subsequent steps where the bypass 

5 element 121 further examines the syntax of any addresses the instructions 151 refer to as 

6 operands. 
7 

t a step 217, the bypass element 121 determines whether the operand ad- 
dresses that tike instructions 151 refer to include identical base address values and offset 
address values. If so, the bypass element 121 generates a bypass signal indicating that the 
instructional 51 refer to the same location in external memory. If not, the bypass element 
121 does riot generate a bypass signal. (In alternative embodiments, the bypass element 
H3 121 may generate an inverse bypass signal). If the bypass element 121 generates a bypass 
I" J 4 signal, tiJe method 200 proceeds with the step 216. If not, the method 200 proceeds with 
JJl5 the step £21. 
16 

17 At a flow point 220, the bypass signal having been generated, the micro- 

18 processor 100 can act on the knowledge that the instructions 151 refer to identical loca- 

19 tions in external memory. For example, if a first (store) instruction 151 and a second 

20 (load) instruction 151 refer to identical locations in external memory, the microprocessor 

21 100 can proceed by using data to be transferred by those instructions 151 from an internal 
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1 register. The microprocessor 100 does not have to wait for external memory to complete 

2 actual store and load operations. 
3 

4 At a step 221, the instruction decode stage 120 couples the parts of the in- 

5 struction 151, including information about the base address value and the offset address 

6 value to the address computation stage 130. 

7 

8 At a step 222, the address computation stage 130 receives the base address 

n 9 value and the offset address value, and computes the effective reference address of the 

,.;I0 instruction 151. 

; : \2 At a step 223, the instruction decode stage 120 couples the parts of the in- 



M3 struction 151, including information about what operations the instructions 151 command 
H4 the microprocessor 100 to perform, and what the syntax of any address the instructions 

j. : 

^3 5 151 refer to as operands, to the instruction execution stage 140. 
16 



17 At a step 224, the address computation stage 130 couples the effective ref- 

1 8 erence address of the instruction 15 1, to the instruction execution stage 140. 

19 

20 At a step 225, the first (store) instruction 151 is physically performed and 

21 completed by external memory. 

22 
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At a step 226(a), if the bypass signal was generated, the microprocessor 100 
proceeds without physically performing the second (load) instruction 151. Instead, the 
microprocessor 100 can use the identical data from it's internal register, thus removing a 
relative delay in microprocessor 100 operation. 

Alternatively, at a step 226(b), if the bypass signal was not generated, or in 
if an inverse bypass signal was generated, second (load) instruction 151 is physically per- 
formed and completed by external memory. 
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1 Alternative Embodiment 
2 

3 Although preferred embodiments are disclosed herein, many variations are 

4 possible which remain within the concept, scope and spirit of the invention, and these 

5 variations would become clear to those skilled in the art after perusal of this application. 
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